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Abstract 

The DO and CDF collaborations recently published two independent analyses that both claim to repre- 
sent the observation of the fti, particle, a baryon made up by a (bss) quark combination. Both signals 
are estimated to exceed the statistical significance of five standard deviations; however, the mass mea- 
surements derived from the candidates differ by over six standard deviations, accounting for estimated 
systematics. Measured rates also appear to differ, although they remain compatible within the large 
uncertainties. 

In this paper the author recomputes the significance of the DO result, showing that it was considerably 
overestimated in the original publication; he then investigates with a pseudoexperiment-based ap- 
proach which, among different hypotheses, appears the most likely cause of the observed discrepancy 
between the DO and CDF signals. 



1 Introduction 



In the last few years the large statistics of proton-antiproton collisions produced by the Tevatron have allowed 
the CDF and DO experiments to shed some light in the largely unknown territory of bottom baryons. The only 
baryon containing bottom quarks directly observed before the turn of the millennium, the Af, [11, has been joined 
by observations of the Sf, and Q, the Et, OUll, and most recently, the Jlfc, first claimed by DO in 2008 |5j, 
and then by CDF this year fSl. The latter two results are in conflict with each other both in mass and production 
rate. Until larger-statistics measurements will be made available one is left wondering which, among several 
concurrent hypotheses, is the most likely cause of the discrepancy, and what is the most credible estimate for the fli, 
baryon mass. This study tries to address the above issues quantitatively using a simple-minded pseudoexperiment 
approach. 

In section 2 the two analyses are briefly summarized. This allows to put in evidence an oversight by DO in the 
derivation of the significance of their observation; an independent assessment of the same number is performed 
with the help of pseudoexperiments, which highlights the impact of the "look elsewhere effect", a common problem 
of searches for signals of unknown mass. Section 3 focuses on the mass determinations of the ilb, and on the causes 
of the observed discrepancy between the CDF and DO measurements. Some conclusions are offered in section 4. 

2 Observations and significances 
2.1 The DO observation 

DO searched 1.3/6^^ of Tevatron Run II pp collisions data for the signal of ilb baryon decays into J/t/jil^ pairs, 
by matching a Jf-ip l^^l-J'^ signal with a fully reconstructed Cl^ AK^ — > {pTr~)K~ decay 0. The analysis 
used a multivariate selection based on "boosted decision trees" to increase the purity of selected events, relying 
on a Monte Carlo simulation of fit, production to model the signal kinematics, and wrong-sign J/^{AK^) events 
found in the data as a model of backgrounds. 

To reconstruct the fif, mass, DO substituted PDG fT) world-average values to the reconstructed mass of J/ tp me- 
son and il^ baryon candidates, which allowed a significant improvement in the mass resolution of the system: 
according to the paper, 

"We calculate the candidate mass using the formula M[Qb) — M{ J/'ipQ^) — Mdi^fj,^) — M(AK^) + 
M{J/ip) + M(f2~). [...] This calculation improves the mass resolution of the MC fib events from 0.080 GeV to 
0.034 GeV." 

The selection of event candidates led to a sample of 79 events with reconstructed invariant mass between 5.65 and 
7.01 GeV. A unbinned likelihood fit of the distribution (see Fig.[T]| extracted to a signal of 17.8 ± 4.8(stat) events, 
with an estimated mass of 6165 ± 10{stat) ± 13{syst)MeV. 



2.2 The CDF observation 

CDF searched for the same final state of fib decays employed by DO, but used a dataset over three times as large, 
corresponding to an integrated luminosity of 4.2/6^^. Instead of optimizing the sensitivity to the fib signal with 
multivariate techniques, CDF opted for a conservative selection aimed at straight, simple requirements, which 
allowed a comparison of the reconstruction of the searched baryon with that of B meson signals with similar decay 
topologies, notably B° J /tJjK* (892)" n+fi"K+n- and 5° J/ipK° ^i+^-tt+t:-. An excellent (12 
MeV) mass resolution for the il^ candidates was obtained by imposing that the reconstructed flight direction of 
A particles intersect with the helix of the negative kaon. Backgrounds were reduced by selecting candidates with 
decay lenghts exceeding 1 cm; silicon hits belonging to particle tracks were used when available, to improve the 
mass resolution of the decay products and further suppress backgrounds. 

^' Particle reactions quoted in this article of course imply charge-conjugate states. 
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Figure 1: Left: The fit to 79 event candidates extracted by DO, which finds a signal of 17.8 events with a claimed 
significance of 5.4 standard deviations. Right: Mass distribution of fib candidates extracted by the CDF analysis. 
Top: all candidates; center: candidates with decay length exceeding 50/im; bottom: candidates with decay length 
exceeding lOO/im. The sample with no requirements on the decay length is the default one used in [6] for a 
combined mass and lifetime fit. 

Mass and yield of the fib baryon were extracted with a HkeHhood fit to the subset of candidates having a recon- 
structed decay length exceeding lOO/im, a requirement predicted to reduce backgrounds significantly. CDF thus 
measured a mass of 6054.4 ± 6.8(stat) ± {).\{syst)MeV and a yield of 12 ± 4 events. An alternative fit using 
both mass and lifetime information together allowed to confirm the signal, extracting a signal of I6I4 events and 
a probability of the null hypothesis P = 4 x 10~^, which corresponds to a significance of 5.5 standard deviations. 
Figure [U shows the mass distribution of the candidates extracted by CDF, for three increasing values of the selec- 
tion requirement on the Jib decay length. Similarly extracted signals of and E.^ baryons allowed a measurement 
of the production rate of Jib particles relative to that of the other baryons. Mass, lifetime, and production rate of 
the signal obtained by CDF agree with theoretical estimates ITJ. 



2.3 An oversight in the DO significance calculation 

The paper published by DO on their 57^ observation fSl may leave the reader with a doubt on the exact procedure 
by which that number is evaluated. Here is the relevant text: 

"To assess the significance of the excess, we first determine the likelihood ^(s+b) of the signal plus background fit 
above and then repeat the fit with only the background contribution to find a new likelihood L^. The logarithmic 
likelihood ratio yj2ln[L(^s+b)l Lb) yields a statistical significance ofb.Acr, equivalent to a probability of 6.7 x 10~* 
that the background could fiuctuate with a significance equal to or greater than what is observed." 

Therefore DO used a standard "log-likelihood approach" to estimate the significance of the peak they find in the 
reconstructed mass distribution. The two concurrent hypotheses were compared using the ratio of their likelihoods: 
a null hypothesis, according to which the data is only produced by background processes and has a reconstructed 
mass distributed with a uniform probability density function (PDF); and the alternate hypothesis that the data 
contains a Gaussian signal on top of a uniform background. The width of such a signal was assumed known, since 
the ilb decays weakly and thus the Gaussian shape only reflects the known experimental resolution in the momenta 
of final state particles, which can be modeled by Monte Carlo simulations; the fib mass, however, was assumed a 
priori unknown, and so was the production rate. 



The histogram in Fig. [T] (left) has only 34 bins, and the number of entries in each of them can be clearly read out 
on the vertical axis. It is therefore quite easy to recreate an identical histogram, fit it with a uniform PDF, note 
the likelihood returned by the fitter, and repeat the fit for the alternate hypothesis, which includes a Gaussian of 
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Figure 2; Result of a binned likelihood fit to the mass histogram of the 79 DO f2f, candidates. The fit returns a 
signal of 18.4 events. 

fixed width and varying mean and normalization. Figure |2] shows the result of this exercise, in the case of the fit 
to the signal-plus-background hypothesis: the result matches well with the original one. Theparameters of the 
fit function are not identical, due to the fact that the original fit performed by DO is unbinnedol however, given 
that the bin width is comparable in size with the experimental mass resolution, those differences do not affect the 
conclusions which may be drawn from the result. If we liken the value of — 2A(log L) to a with one degree of 
freedom, we may compute the probability of the null hypothesis as P{x^, 1); from the probability we arrive at a 
significance using the formula 

N = V2xErf-'[l-Pix^l)] 

where Erf^^ is the inverse of the error function. By this recipe we get the numbers in the middle column of the 
table belo\\l£3 : 





This study 


Ref. |5| 


Likelihood of null hypothesis 


70.03 


not quoted 


Likelihood of the alternate hypothesis 


55.38 


not quoted 


Probability of the null hypothesis 


6.2 X 10-8 


P = 6.7 X 10-8 


Significance of the observed signal 


5.41 St. dev. 


5.4 St. dev. 



Despite the approximation of using a binned likelihood to fit the mass histogram, the results of [5J are nicely 
confirmed. Unfortunately, the above conversion of the delta-log-likelihood value into a probability, and therefore 
also the significance quoted by DO, is erroneous. In fact, when one fits the data with the alternate hypothesis, one 
is adding two free parameters to it: not just the normalization of the Gaussian signal, but also its free-floating mass. 
On this point the DO article specifies that "We fix the Gaussian width to 0.034 GeV, the width of the MC fib signal". 

^' Individual mass values of the 79 DO candidates are unavailable. 

One caveat is that the delta-log-likelihood will in general only distribute as a function only in the asymptotic limit of 
large number of entries per bin, which is not a regime which applies here. 
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It is reasonable to assume that if the fitting procedure had also entailed fixing either the mass or yield (both of 
which are a priori unknown) in the fitting function for the alternate hypothesis, the paper would have reported it. 
Thus, DO appears to be throwing in two extra degrees of freedom to find the fli, signal, and a correct calculation of 
the significance must account for that, because the factor — 2A(logi) will distribute like a with two, and not 
just one, degrees of freedom. By taking this into account, the following results are obtained with the likelihood 
values quoted above: 

• ProbabiUty of the nuU hypothesis: P — 4.3 x 10~^; 

• Significance of the observed signal: 5.05 standard deviations. 

A 5.05(7 signal is seven times more probable to result from a statistical fluctuation than a 5.4(T one, so the detail is 
worth noticing. This inaccuracy in the DO publication alone does not of course disprove the repoted observation, 
although it decreases the strength of the result. A pseudoexperiment-based approach may be used to further check 
the significance. 



2.4 A check of the DO signal significance with pseudoexperiments 

A pseudoexperiment mimicking signal extraction from the DO fib candidates consists in filling a 34-bin mass 
distribution of range equal to the fib histogram shown in Fig. |2] with 79 entries, sampled according to a uniform 
PDF, then trying to fit a Gaussian signal somewhere in the spectrum[f3 on top of a constant background. 

The straightforward procedure includes two steps per each pseudo-histogram [f^: a fit to a uniform PDF testing 
the null hypothesis, and then a fit of the same histogram adding to the uniform PDF the two degrees of freedom 
of a Gaussian signal, of width fixed to the experimental mass resolution quoted by DO (the alternate hypothesis). 
The difference between the likelihood of the two fits can finally be converted in a significance, using the recipe 
described in the previous section. From repeated trials of this procedure, a picture can be obtained of the probability 
distribution of the number of signal events that may be fit in the absence of a signal, and the corresponding 
computed significance. One may thus infer by a ratio between successes and total trials whether the mass bump 
found by DO is something that happens by chance only 6.7 times every hundred-millions (as DO claims), or rather 
4.3 times every ten millions (as obtained by using two degrees of freedom in the calculation), or more frequently 
so; the distribution of significances from the — 2A(logL) values is additional information that may be used to 
check the frequency ratio. 

In a 6,348,982 pseudoexperiments run, 26 histograms resulted in a signal of just above 18.4 event^^ with a 
corresponding probability of PnuU = 4.1 ± 0.8 x 10~^, equivalent to a significance of 4.61 standard deviations. 
The distribution of the number of events returned by the fit and corresponding significance are shown in Fig. [3] 



It is instructive to also examine the additional distributions shown in Fig. lU there one clearly observes that the 
Gaussian degrees of freedom are fully exploited by the fit, which scans the mass values in search for the most 
profitable way to use the two extra degrees of freedom (mass and normalization of the Gaussian) to increase the 

Although it might be argued that a preferable procedure consists in varying the number of entries for each pseudoexperiment 
according to a Poisson distribution, we avoid this simple modification because what we mean to test is the calculation of the 
significance of the actual histogram used by DO. This kind of conditioning (8l|9) is generally accepted by statisticians. 

We note here that there are a unavoidable set of software implementation details and arbitrary choices that potentially affect 
the results of a test with pseudoexperiments. Among the former we may quote the choice of random-number generator 
employed for the construction of pseudo-data templates; we use TRandomS 1101 . following the recommendation of the 
developers of the root package. Among the latter are the initial value of fit parameters modeling the alternate hypothesis, 
their allowed range (e.g. if the normalization of the Gaussian distribution is enforced to be positive), and the procedure by 
which their full scan is enforced. Pseudoexperiment results are thus not immune from systematic effects; nevertheless, if 
very well-defined questions are posed the answers are typically well-reproducible. 

The binned-likelihood fit to the DO mass histogram returns 0.6 more events than the unbinned fit quoted by DO; of course, 
the results of binned-likelihood fits to pseudo-histograms must be compared to the result on real data obtained with the same 
method. 
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Figure 3: left: Number of signal events in the Gaussian (of width equal to the DO mass resolution) fit in pseudo- 
histograms containing 79 events. Right: Significance of DO-like pseudoexperiments, computed using delta-log- 
likelihood values. The wiggling of the distributions reflects the discreteness of the distributions created by the 
pseudoexperiments. 

likelihood. But the two degrees of freedom only account for local adjustments of the global likelihood, while the 
freedom of the fit (or rather, the experimenter) to set his or her attention on a fluctuation anywhere in the distribution 
amounts to a further derating of the actual significance: this is the well-known "look-elsewhere effect". Since the 
signal has a width of size similar to the bin width, and will thus typically involve ^ 3 adjacent bins simultaneously 
fluctuating upwards, one expects that the true probability of a signal occurring in a non-a-priori-specified spot is 
larger than the probability to observe it in any specific spot by a trials factor of the same order of magnitude of 
which is roughly the number of independent regions where a signal may be sought. This is well borne 
by the ratio between the probability computed by the pseudoexperiments Pnuii and the probability computed with 
the likelihood difference P/F\ 



Pnuii/ Pa 



4.1ifc0.8xl0- 
4.3x10-7 



9.5 ± 1.9 ~ 10.33 = Nbins/^- 



Our results are not in contrast with what is reported in a document answering frequently-asked questions on the 
ilfc observation, which was made available on May 27, 2009 in the DO collaboration web site 1 1 1 1: 

What we report is purely the statistical signiflcance based on the ratio of likelihoods under the signal-plus- 
background and background-only hypotheses. Therefore, no systematic uncertainties are included, although we 
have verified that, after all systematic variations on the analysis, the significance always remains above five stan- 
dard deviations. Our estimate of the significance does also not include a trials factor We believe this is not 
necessary since we have a specific final state (with well-known mass resolution) and a fairly narrow mass window 
(5.6-7.0 GeV) where we are searching for this particle. [...] 

The statement above, according to which the inclusion of a trials factor is unnecessary, given that a narrow mass 
window is tested, is surprising. Indeed, the inclusion of a trials factor of about a factor of 10 is necessary, as proven 
above. 



In order to take in account the effect of the hand and the eye of the experimenter, who is called to provide the fit with a 
starting value of all free parameters, the fits to the pseudo-histograms are performed by choosing a sufficient number of 
points along the x axis (10 in our case) as starting mass values; the fit returning the maximum likelihood among the set is 
then considered the one that would be picked in a real experiment. Fit results improve with this procedure, which invites the 
minimization routine to scan fully the parameter space in order to search for the best fluctuation. As far as the normalization 
of the Gaussian is concerned, fit results depend much less strongly on its starting value; zero events were used for the tests 
described here, but the normalization was constrained to be positive in the fit. 
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Figure 4: Left: number of fit events versus fit mass in the background- only pseudoexperiments mimicking the 
experimental data of DO. Right: the pseudo-histogram which mimics the largest signal in the set of over 6.3 
millions. 

It is instructive to inspect the pseudo-histogram with the largest signal among the generated ones in Fig. |4] Once 
in a few million cases, a real beautiful peak does appear by chance! 

3 A discrepancy and its possible causes 

Regardless of the notes made in the previous section about the real significance of the DO signal, each of the two 
observations of the fit resonance appears to provide, at first sight, convincing evidence of the existence of this 
heavy baryon: in both cases one observes a quite distinctive decay chain: one not very different from that which 
convinced physicists of the existence of the fl^ (sss) baryon in 1964, based on one single striking image obtained 
by the 80-inch bubble chamber at Brookhaven. However, the two results constitute an embarassing problem if 
taken together The CDF paper puts the matter very bluntly in the introduction: 

"In this paper, we report the observation of an additional heavy baryon and the measurement of its mass, lifetime, 
and relative production rate compared to the production. The decay properties of this state are consistent with 
the weak decay of a b-baryon. We interpret our result as the observation of the fib baryon (\ssb >). Observation 
of this baryon has been previously reported[6], however, the analysis presented here measures a mass of the 0,^ to 
be significantly lower than ref.[6]". 

Reference [6] above is, of course, the DO paper, which we have discussed in section 2. Let us place side-by-side 
the two rib mass determinations: 

• Mdo = 6165 ± 10 ± lUIeV = 6165 ± 16.4A/ey; 

• McDF = 6054.4 ± 6.8 ± 0.9MeV = 6054.4 ± 6.9MeV. 

where statistical and systematic uncertainties quoted by each experiment have been added in quadrature for the 
sake of comparing the nominal total error of the two determinations. 

One should immediately note a few things from the numbers above. One: the CDF measurement has an error 
bar 2.4 times smaller than the DO measurement. Two: the DO measurement has a systematic uncertainty which is 
twice as big as the total uncertainty of the CDF measurement. Three: the systematic part of the uncertainty in the 
CDF measurement {0.9MeV) is virtually irrelevant -a by-product of the performant charged particle tracking of 
CDF, its careful calibration, and the analysis method chosen in the search of fif, candidates. Four: the two mass 
determinations differ by llO.QMeV. If we were to fully trust the quoted CDF and DO uncertainties, we would have 



7 



to conclude that the two experiments have measured two distinct particles! In fact, their "difference", in units of 
total uncertainty, is of 6.2 standard deviations if one adds all uncertainties in quadrature; more conservative recipes 
do not change the picture appreciably. Given the quoted significances of the two signals stand in the whereabouts of 
5 standard deviations each (4.6-sigmaas estimated in section l24l for the DO signal, 5.5-sigma forCDif!)]), if looks 
more likely that these be two distinct particles, rather than either of them be simply a fluctuation of backgrounds. 
The matter requires some further investigation, which is offered below. 

3.1 Hypotheses for the discrepancy 

The two mass measurements disagree by more than six standard deviations, and they both possess an observation- 
level significance, if barely so. The hypothesis that the two signals represent different particles cannot be discarded 
a priori, but this is at the very least problematic: one should then explain why each experiment only sees one of 
the two states. An approach to the problem can be to try and determine how likely it is that only one of the two 
results is correct, and the other is wrong. 

Let us admit for the sake of argument that the CDF result is correct: you may then take the fib mass and production 
rate as measured by CDF, and plug these numbers in a pseudoexperiment generation, to determine what would DO 
be expected see in their data under such conditions, and how likely it is that they would find a significant signal at 
a llQ.QMeV or larger distance from Mcdf- 

Some additional input is needed in order to carry out this exercise: specifically, we need to determine the rate of Vlb 
events which would be accepted by the DO selection under the hypothesis that the production rate of that particle 
is the one computed by CDF. In Ref.Q a rate comparison is indeed offered: 

"The relative rate measurement presented in Ref.[6] is ^ j/^^- j ~ ^-^^ ^ 0.32(stat) j;Q'22(syst) 

where f{b fl^^) and f(b^ Sj^") are the fractions of b quarks that hadronize to U,^ and S^. The equivalent 
quantity taken from the present analysis is "^^/^-If /^-^'^/^-^n^ — 0-27 ± Q.12[stat) ± Q.Ql{syst). Neither 
measurement is very precise, since a ratio is taken of two small samples. Nevertheless, this analysis indicates a 
rate offl^ production substantially lower than Ref.[6]". 

Noting that the DO estimate of the rate fraction of ilf, and Sf, baryons already includes the statistical uncertainty in 
the number of ilb candidates, the number of events to generate in a DO-like pseudoexperiment may be calculated 



j^j-exp _ 1 7 Q V 0.27ifc0.12ifc0.01 _ n+3-95 

^^DOICDF - X 80^0 32+0.14 - b.U_3,74, 

where, for simplicity, statistical and systematical uncertainties of each rate determination have been added in 
quadrature, and Gaussian distributions have been assumed. For later use, the corresponding number ^cd'f|_do' 
referring to the 12 ± 4 events extracted by the mass-only fit of the distribution shown in the bottom histogram of 
Fig.m is also given below 

njexp _ 1 9 V °-^°=^°-^^-0.22 — Qc; a+22.2 

^^CDF\DO — -L^ ^ 0.27±0.12±0.01 ~ 'J'J-"-23.4- 



As noted above, the insufficient information provided in the CDF publication prevents a check of the significance they 
claim for their Qb signal, which is obtained from a two-dimensional fit to mass and lifetime together; we should expect 
that a proper accounting of the "look-elsewhere effect" might decrease the CDF significance by a similar amount as what 
we observe for the DO signal; Ref. |6| however notes, referring to its mass-only fit, that "This calculation was checked 
by a second technique, which used a simulation to estimate the probability for a pure background sample to produce the 
observed signal anywhere within a AQQMeV / c? range. The simulation result confirmed the significance obtained by the 
ratio-of-likelihoods test". Being unable to verify this statement, we have to rely on it; we expect that a larger search window 
would have derated the quoted significance by a few decimal points. 

^' Since the mass-only fit by CDF refers to the sample with decay length above lOO/im, while the relative rate is obtained 
by relaxing that requirement and performing a combined mass-lifetime fit, in principle a part of the statistical error on the 
absolute rate should be retained in the error propagation; because of insufficient information this effect is neglected. We 
also ignore the possible difference between the rate of events in the loose and tight selections. 
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Figure 5: Results of 961,998 binned-likelihood fits to 79-event pseudo-histograms generated with a CDF-like 
signal of normalization chosen as explained in the text. Left: number of events returned by the fit as a function of 
the fit mass; right: relative fraction of pseudoexperiments returning a signal of Nju > 10 events. Note the outlier 
bins above the fit line on each side of the Gaussian. 

Mass distributions of 79 events can then be generated by taking 6.OI3 Y4 entries (allowing for variations within 
uncertainties) from a Gaussian distribution of mass equal to Mcdf = 6054.4 ± 6.9MeV and width equal to 
iAMeV (DO's experimental mass resolution), and the remaining ones from a uniform background PDF. The re- 
sulting histogram can be fit a ' la DO, as done in the previous section. Under normal conditions, the fit will return 
what was given in input: a signal of about Nfn — 6 events, sitting at Mfu ^ Mcdf (give or take fifteen MeV or 
so). One might wonder, however, whether an upward fluctuation of the number of generated signal events might 
occasionally conspire with a weird background fluctuation occurring at masses just above or below 6054Af eV to 
create a bump yielding a larger number of i7f, decays, at a mass significantly different than Mcdf- As discussed 
in section l24l a binned likelihood fit to the distribution observed by the DO collaboration results in a signal of 18.4 
events. How often does this happen for |A//it — Mcdf\ > llO.GMeV in the situation just hypothesized ? Well, 
not quite often: in a million-pseudoexperiments run, no such occurrences are observed. 



In the graphs of Fig. |5] one can see that a large fraction of the million pseudoexperiments return the correct an- 
swer: mass and normalization close to the generated ones. It may also be noted that the fit is not prevented from 
sometimes using the two Gaussian degrees of freedom to model a different fluctuation happening elsewhere in the 
spectrum: that is the cause of the band spanning the whole mass range in the left graph of Fig. |5] The band is 
centered at Nfu ^ 6 events by pure chance; it is a feature which depends on to the number of generated data in 
the fitted histogram and the width of the signal which is sought. 

From the test one also observes that there are two effects at work in determining the likelihood of fits returning a 
large signal at a significantly displaced mass value from the generated one. The first is the fact that the presence 
of a 6-event signal at a mass Mc d f reduces the number of events distributed uniformly in the mass spectrum, and 
conseuqently the likelihood of a large Poisson fluctuation of the background alone; the second is the p ossibility of 
a "spill-over" of the generated signal, due to the combination of fluctuations and binning effects The former 
effect needs no commentary; the latter is maybe better appreciated by examining the right panel in Fig.|5] There, 
the fraction of pseudoexperiments returning a signal of 10 or more events is displayed as a function of Mfui^. 
We observe a probability of 3.7 x 10^'* that a fluctuation of 10 or more events is picked up by the fit away from 
Mc D F, where the signal is actually generated. However, even in the cases when the fit does converge to masses in 
the vicinity of the generated mass (which are the vast majority), we do see a significant non-Gaussian tail in Mf it- 
This tail is wide enough to influence the probability of fitting masses at \Mf it — Mcdf\ > llO.GMeV, at least 
for the case of Nfn > 10 signal events. 

We conclude that the observed DO signal can hardly be attributed to a "statistical leak", a spill-over of a nearby 
peak, if the CDF mass and rate measurements are correct. The issue will be revisited when we modify some of the 

It is important to reiterate here that since these tests are based on a binned-likelihood fit, the conclusions that may be drawn 
from them are only approximately valid for the experimental situation of DO. 

A signal of 10 or more events rather than 18.4 has been chosen to illustrate qualitatively the effect because the statistics of 
pseudoexperiments returning 18.4 or more events is too scarce. 
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1 /sqrt(6.2831 83*[0]*[0])*exp(-0.5*(pow((x-[1 ])/[0],2))) ~| 




Figure 6: Graphical explanation of the method used to compute the probability of a mass measurement at least 
as distant from the CDF measurement as the one obtained by DO. The red line is at Mcdf = QQbAAMeV; the 
Gaussian has a mean equal to the fit mass of a pseudoexperiment finding a signal exceeding 18.4 events, and a 
width equal to the one expected if a large scale factor k (exaggerated for display purpose) is hypothesized for the 
systematical uncertainty in the DO mass measurement. By integrating the blue area of the Gaussian, we obtain an 
estimate of the probability that a value as discrepant as the DO one was observed. 

assumptions, in section [373] There, we will see that the leak may indeed have an impact in formulating a hypothesis 
for the CDF/DO controversy on the 0^ baryon. 

3.2 The first hypothesis: underestimated mass systematics 

If the Tevatron experiments had measured the fif, mass value with larger error bars there would be no controversy, 
but just a mild disagreement in the measured rate of ilh production. The relevant uncertainties we need to put under 
scrutiny are of course the systematical ones; we observe that the DO mass systematic uncertainty (((5M)^g* — 
liMeV) totally outweighs the CDF one ({SAiyj^p = 0.9MeV). Therefore, one plausible hypothesis of the 
source of the CDF/DO discrepancy lies in non-well-controlled systematical uncertainties in the mass determination 
produced by the DO collaboration. In the akeady cited frequently-asked-questions document [11], they note: 

We have adopoted an approach where the systematic uncertainty on the mass is estimated by comparing the 
measured mass value after performing small variations to the analysis (e.g. different selection criteria). At this 
level of statistics, this introduces a significant statistical component to this systematic uncertainty which is expected 
to be reduced in the future with larger data sets or simply by performing a more refined evaluation of the systematic 
uncertainty via large MC samples[...]. 

While waiting for those studies, we may test the hypothesis that the DO mass systematics are underestimated by 
inflating them with a multiplicative scale factor k, and using that value in pseudoexperiments, to assess by what 
factor would the DO mass systematics need to be increased in order to obtain a reasonable probability that they 
observed 18. or more events at a mass of Moo = 6l65MeV or further away from Mcdf- 



Since we mean to test an ensemble of situations, each of which has a tiny probability of occurrence, it is too 
CPU-time consuming to rely on the usual pseudoexperiment calculation of a probability as a number of successes 
divided by number of trials. One may circumvent this problem by performing a different but asymptotically 
equivalent calculation, which is graphically illustrated in Fig. |6l For each hypothesis on the scale factor k we 
may perform pseudoexperiments in which pseudo-histograms contain 79 events, 6.0l'3'74 of which are taken to be 

As already noted, to be consistent we take our binned-likelihood result as a reference value for the DO signal. 
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Figure 7: Probability to observe a DO-like signal in data containing a CDF-like one, as a function of the scale 
factor k applied on the systematic uncertainty affecting the DO mass measurement. 

signal events with a mass A/c_D_F = 6054.4 ± 6. QMeT^. This time, for each fit returning 18.4 or more signal events 
we integrate in the range A = [— oo, 2Mcdf — Mdo] U [Mdo, oo] a Gaussian function centered at Mfu, of width 
equal to a{k) = \/lO^ + x 13^MeV, normalizing by the number of trials: 



P{k) 



S(iV>18.4) ^/^^/a 



2CT(fc)2 



dx 



Mfit, the mass returned by the fit, is expressed in MeV. The above formula defines a scale-factor-dependent 
probability that DO obtained a signal at least as discrepant with Mc df as one observed, and with a normalization 
of 18.4 events or larger, assuming that the data actually contained a fif, signal with mass equal to that measured by 
CDF within uncertainties, and rate compatible with the CDF rate. All this can be studied as a function of k, the 
scale factor affecting the 13-MeV systematic uncertainty assigned by DO to their mass measurement. 



The result of the exercise is shown in Fig. [T] The graph stresses the fact that for fc = 1 the probability that DO find 
18.4 or more signal events at M = 6165Mey, given a fib with mass of 6054.4 ± 6.9AIeV producing 6.0^3 74 



events in their sample, is very small by blowing up the DO mass systematics by a factor three, however, the 
probability rises to about a half-thousandth; a factor fc ~ 6 is necessary to bring it to three-sigma values. The two 
mass measurements are not altogether too incompatible, if we assume that the CDF result is correct and if we are 
willing to admit that the DO systematics were seriously underestimated. 

The same exercise just discussed could of course be performed by taking the DO stand: that is, one might now 
assume that DO obtained mass and production rate of ilb baryons right, and verify how likely it is that CDF could 
get a mass result discrepant with the true value by fitting their mass distribution, as a function of a scale factor 
multiplying the CDF mass systematics. To circumvent the unavailable information on the mass versus lifetime of 
all CDF candidates it is in principle possible to rely on the distribution at the bottom of Fig. [T] which is a low- 
background, 35-event selection used as the basis of the preliminary mass-only fit described in the CDF publication. 



Much smaller, in fact, than the one corresponding to the hypothesis that there is no signal anywhere in the spectrum, which 
we have estimated at P„uii = 4.1 x 10^'' in section f2A[ because we are now testing a quite different null hypothesis, 
namely that the two experiments are compatible both in mass and rate. However, it is to be noted that the smoothness of 
the curve in Fig.|7]is deceiving, since it hides the fact that it is based on just a million-pseudoexperiment test: probabilities 
below 10"'' are untrustworthy. 
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where they find a smaller-significance signal corresponding to a 4.9(7 effect according to CDF. This time, however, 
there is an evident problem of self-consistency of the hypothesis. The signal rate estimated by DO is almost three 
times as large as the one estimated by CDF, so one would have to create the pseudo-CDF histograms by inserting 
35.6 signal events, as computed in section [37T] above, in a histogram containing a total of 35. The problem is that 
one cannot ignore that the majority of the 35 events contained in the original CDF histogram are incompatible with 
being events, regardless of whether AIdo or Mcdf is assumed to be the correct fif, mass. A more meaningful 
way to question the accuracy of the CDF result for the sake of bringing the two mass measurements in agreement 
is described in the next section. 



3.3 The second hypothesis: a DO mass bias and a CDF rate error 



The observation that rate measurements in both experiments are imprecise suggests one to test a different hypoth- 
esis to investigate further the discrepancy. One may study the probability that DO observed a signal at a mass 
such that IMdo — Mcdf\ > 110-QMeV, simultaneously as a function of the scale factor k on the DO mass sys- 
tematics and of an independent scale factor 7 on the fib signal expected in the DO histogram given the CDF rate 
measurement. For 7 = 1, 6.6^3 74 events should be present in the DO mass histogram, and from the test of the 
previous section the case k — 1 can be judged highly unlikely; however, for a larger value of 7 the "spill-over" 
effect discussed in section [3T| might make the DO observation more likely. 

The test is performed by choosing nine values from 1.0 to 5.0 of the rate scale factor 7, and constructing for each 
of them 500,000 pseudo-histograms in which the mass of Nq^ = 6.0 x 7 entries is sampled from the CDF fli, 
mass measurement (Mq df — 6054.4 ± Q.9MeV) with a iAMeV resolution, and the remaining 79 — Nq_^ entries 
are obtained from a uniform distribution. Along with the nine values of 7, 100 values of the scale factor k are 



sampled from 0.1 to 10.0|1^; the calculation of probability of the DO observation follows the method described in 
the previous section. Results are presented in Fig.[8j a selection of numerical results is also provided in the table 
below. 



DO mass syst. scale factor 

k 


CDF rate scale factor 

7 


Equivalent CDF rate bias 

N{a) = (7- l)/0.45 


Estimated compatibility 
P 


1.0 


1.0 


0. 


3.2 X 10"** 


2.0 


1.0 


0. 


4.4 X 10-6 


3.0 


1.0 


0. 


2.1 X 10-5 


4.0 


1.0 


0. 


7.5 X lO-'^ 


5.0 


1.0 


0. 


1.6 X 10-"* 


1.0 


2.0 


2.2 


4.8 X 10-8 


2.0 


2.0 


2.2 


3.3 X 10-5 


3.0 


2.0 


2.2 


7.6 X 10-4 


4.0 


2.0 


2.2 


3.5 X 10-3 


5.0 


2.0 


2.2 


8.0 X 10-3 


1.0 


3.0 


4.4 


3.9 X 10-8 


2.0 


3.0 


4.4 


1.4 X 10-"* 


3.0 


3.0 


4.4 


4.2 X 10-3 


4.0 


3.0 


4.4 


2.0 X 10-2 


5.0 


3.0 


4.4 


4.8 X 10-2 



Before we try to interpret the above numbers, a few points must be made about their determination. 



• The two scale factors k and 7 have a quite different nature: the first refers to an increase of the systematic 
error in the DO mass measurement, while the second is a factor scaling up the effective rate of Q.b baryons 
with respect to the CDF measurement. Since the latter is measured with a 45% relative uncertainty, a rate 
scale factor 7 = 3.0 equates to a CDF underestimate of the rate by 4.4 standard deviations, as indicated in 
the third column. 

As for the test of section [T2l there is no need to re-generate pseudo-histograms to test different values of k: one just needs to 
compute 100 different values of the integral for each pseudoexperiment returning 18.4 or more signal events. For 7, instead, 
different sets of pseudoexperiments are needed. 
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Figure 8: Probability to observe a DO-like signal in data containing a CDF-like one, as a function of the scale 
factor k applied on the systematic uncertainty affecting the DO mass measurement ( running from 1.0 to 8.0 on the 
X-axis), and as a function of the scale factor 7 applied on the rate offlt candidates expected in the DO histogram 
by assuming the CDF measured rate ( running from 1.0 to 5.0 on the y axis). See the text for caveats and details. 

• Another thing to note about these numbers is that they do not directly compare to the probabihty extracted 
with background-only pseudoexperiments discussed in section l24l (P,„,;; = 4.1 ± 0.8 x 10~^). The reason 
is that we have been testing two very different questions. In the test of the null hypothesis of section lZ^l one 
searched anywhere in the mass spectrum for a signal with a normalization exceeding 18.4 events, among 79 
mass values distributed uniformly; here, instead, we refer to a situation where a signal is present, and try to 
determine how likely it is that a signal is fit at a mass at least WQ.QMeV away from the one measured by 
CDF. The numbers indicate that the DO and CDF mass values are so distant that a leak of signal events from 
the "true" mass (assumed to be Mcdf) to the vicinities of A/^iq is unable, for 7 = 1, to make up for the 
concurrent effect: the Gaussian degrees of freedom are used, in the vast majority of cases, to accommodate 
the few mass values really generated at Mcdf, depleting the chance of a fluctuation where DO sees its 
signal. 

• The method used to compute probabilities, based on the integration of Gaussian functions, provides a certain 
level of smoothness in our estimates of very small probabilities, but it does not protect them from the large 
random fluctuations intrinsic of the pseudoexperiments. This is evident by observing the erratic behavior of 
the part of the surface in |8] corresponding to small k: a few pseudoexperiments fluctuating to yield a signal 
above 18.4 events at a mass close to Af^o among the 500,000 generated for 7 = 1.0, and similarly for the 
set generated for 7 = 3.5, produce steps in a surface whose real shape should be smooth and monotonous. 

The numbers presented in the table clearly show that a decrease of the 6.2cr discrepancy between the CDF and 
DO mass measurements to a less-than-3a effect can be obtained by several combinations of causes. We list two of 
them below, which join the simpler fc > 1, 7 = 1 cases to which the tests described in section [J!2] correspond. 

1. A choice of fc = 3 and 7 = 3 brings the observed discrepancy to an estimated probability of 4.2 x lO"'^; 

2. If one only accepts that the CDF rate measurement is underestimated by a factor of 2 (a 2.2(T effect, if one 
believes the CDF rate uncertainty), then a DO mass systematics SF fc = 4.0 is again sufficient to bring the 
probability of the observed discrepancy to 3.5 x 10^"^. 

Of course, a numerical analysis such as the one above is useless if it is not complemented by physical insight 
based on hard facts: how the analyses were performed, what could have gone wrong, what implicit biases affect 
the experimental situation. It is the opinion of the author that the most likely hypothesis for the observed conflict 
of mass measurements of the VLi, baryon is indeed the conspiracy of a combination of factors: those examined 
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above, but also others, which are easily overlooked because they are of exogenous nature. One of them might be 
the fact that CDF performed its measurement after DO found a signal at a mass discrepant with the most credited 
predictions for the sought baryon. It is likely that this fact led CDF to choose the most robust method to measure 
the Vlb mass: their selection of the data is based on straight cuts rather than advanced analysis techniques, for the 
declared purpose of retaining the possibility to calibrate the mass reconstruction of the fJfc to that of well-known 
lighter baryons and mesons yielding a similar decay topology, which are retained by the conservative selection. 
CDF thus apparently traded in a less-than-optimal rate measurement for the best possible mass measurement. If 
that is the case, a discrepancy in the mass between DO and CDF -fostered by a sub-optimal rate uncertainty in the 
CDF measurement- becomes more likely. 



4 Conclusions 



The recent mass estimates of the fi;, baryon obtained by the DO and CDF collaborations in their Run II datasets 
disagree by more than six standard deviations. The extracted signals which are the basis of those estimates are also 
quite unlikely to be due to statistical fluctuations of backgrounds. The inconsistency calls for more investigations, 
which the Tevatron experiments will no doubt produce in the near future. In the meantime, an assessment of the 
situation from a statistical standpoint is called for. 

In this paper we offer the results of a study of the compatibility of the DO and CDF results, performed to try 
and quantify their apparent inconsistency with several simple tests. A check of the calculation reported in the 
DO publication demonstrated that the significance quoted by the DO collaboration is overestimated, both because 
of an inconsistent calculation and because of their neglecting a trials factor The possibility of underestimated 
systematic uncertainties in the DO mass measurements is then considered with pseudoexperiments, in combination 
with a hypothesis that the CDF measured yield of Vtb decays is underestimated. By assuming the CDF mass 
measurement is correct, it is proven that the likelihood of a DO result as discrepant and as significant as the one 
seen also depends on the rate bias assumed in the CDF result. As a result of the calculations presented in this 
paper, a viable hypothesis can be put forth: if mass systematics quoted by DO are inflated by a factor of three and 
the signal rate measured by CDF is inflated by a similar amount, the apparent 6.2-standard-deviation discrepancy 
between the CDF and DO results gets reduced to a less-than So- effect. 

At the time of writing, the Tevatron collider is just about to cross the mark of 7 inverse femtobarns of proton- 
antiproton colUsions delivered to the two experiments; a five-fold increase in statistics for the DO analysis is thus 
possible. It is therefore only a matter of time before the apparent inconsistency between the two observations of 
the Vlb baryon is resolved. 
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